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Abstract. We define a class of functions which have a known decay rate coupled with a periodic 
fluctuation. We identify conditions on the kernel of a linear summation convolution Volterra 
equation which give the equivalence of the kernel lying in this class of functions and the solution 
lying in this class of functions. Some speciflc examples are examined. In particular this theory is 
used to provide a counter-example to a result regarding the rate of decay of the auto-covariance 
function of an ARCH(oo) process. 



1. Introduction 

This paper characterises the exact decay rate of the solution of the discrete hnear Voherra 
equation 

n 

(1) X{n + 1) = f{n + l)+Y,U{n-j)X{j), n e Z+ , X{0)^Xo, 

j=o 

where / : Z+ -> R'', t/ : Z+ -)> R''^'' and Xq e M''. The exact rate of decay of the forcing function, 
/, is known and the kernel U has known decay and periodic asymptotic behaviour. We define the 
associated resolvent equation of (P) 

n 

(2) Z{n + l) = Y,U{n-j)Z{j), n £ Z+, Z{0)=I, 

j=o 

where Z : Z+ M.'^^'^ and / is the identity matrix. By first examining ^ we can more easily 
analyse ((TJ via a variation of constants representation: 

n 

(3) X{n)^ Z{n)X{0) + J2z{n-j)f{j), ne{l,2,...}. 

It is shown in that when the kernel of ([T]) has a particular rate of slower than exponential decay 
(e.g., polynomial or regularly varying decay), then the solution of ([2]) also has this exact rate of 
decay. It is from this class of weight function that the rate of decay of U in the present work 
is imposed. It is shown in [51, |3] and ^ that periodicity in the kernel of perturbed summation 
Volterra equations implies periodicity in the solution of these equations. The stability of solutions 
of perturbed summation Volterra equations is also shown. Linear Volterra convolution and non- 
convolution equations are studied in , where conditions on the summability of the resolvent 
and stability of the solution are used to establish the existence of a unique bounded (in particular 
periodic and almost periodic) solution. Conditions guaranteeing the existence of asymptotically 
periodic solutions of linear non-convolution summation Volterra equations are derived in [5| via 
an application of admissibility theory. 
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Section [2] gives some fundamental definitions as well as various lemmata needed in the proof 
in Section [31 In Section |3] the main result establishes that the solution of ^ also decays at 
the same rate as the kernel and the periodic component is preserved. This result is achieved by 
eliminating the effect of the periodicity, by evaluating at iV discrete time points, where N 
is the value of the period, and lifting the equation to a higher space dimension in which it is 
asymptotically autonomous. Then by a careful separation of the summation term we can form 
a system of equations to which we apply the admissibility theory of [2]. Moreover, it can be 
shown in the case when the kernel is "small" in some ^^(Z+) sense, that Z has periodic decaying 
asymptotic behaviour if and only if U does, and indeed both sequences can be majorised by the 
same weight function and possess the same period. In forthcoming work, it is planned to investigate 
more general forms of decay in both continuous and discrete equations, where the decay can be 
separated into a rate and a bounded component with some structure (such as the periodicity 
studied here). Lastly, in Section 2] the results developed in Section [3] are applied to demonstrate 
that if a periodic fluctuation is present in the kernel of an ARCII(oo) processes then this periodic 
component propagates through to the auto-covariance function of the ARCII(oo) process. This 
example sheds further light on extant research on the memory properties of ARCH(oo) processes 
(see e.g., [5l[7l[l0]). 

2. Preliminary Results 

If d is a positive integer, the space of all d x rf real matrices is denoted by M'*^'^, the zero 
matrix by and the identity matrix by /. A matrix A = (Aij) in R'*^'' is non-negative if Aij > 0, 
in which case we write ^ > 0. A partial ordering is defined on M'^^'' by letting ^ < i? if and 
only if B - ^ > 0. Of course A < B and C > implies that CA < CB and AC < BC. The 
absolute value of A = {Aij) in M.'^'^'^ is the matrix given by (|A|)y = \Aij\. M.'^^'^ can be endowed 
with many norms, but they are all equivalent. The spectral radius of a matrix A is given by 
p{A) = lim„^oo ||A"ir^"i where || • |j is any norm on W^^'^; p{A) is independent of the norm 
employed to calculate it. We note that p{A) < p{\A\). Also if < A < B, then p{A) < p{B). 
Also, 

(4) p{A) < ||A''^f/^Vfc e N 

We use, in this paper, the matrix norm ||A||oo = max y^,^_, lAi ,1. 

l<i<JV ^ '■' 

The set of integers is denoted by Z, and Z+ = {n e Z : n > 0}. Sequences {u{n)}n>o in I^'^ or 
{U{n)}n>o in E'*^'^ are sometimes identified with functions u : Z+ ^ and U : Z+ ^ R'^'"^. If 
{U{n)}n>o and {V{n)}n>o are sequences in M.'^^'^, we define the convolution of {{U * V){n)}n>o 
by (U * V){n) = X]j=o U{n — j)V{j) for n > 0. Moreover using this definition of convolution one 
may recursively define the j-fold convolution, {(?/*■' )(n)}j>2.ri>0i by (U*'^){n) — ([/ * U){n) and 
{U*^){n) = ([/*0-i) * U){n) for j > 3 and n > 0. The Z-transform of a sequence {C/(n)}„>o is 
the sequence in M''^'* is defined by U{z) = J^'jLo U{i)z^-' , provided 2 is a complex number for 
which the series converges absolutely. A similar definition pertains for sequences with values in 
other spaces. 

Let C e M''^'', then we say that C is a circulant matrix if Cij = Cd+i-j+1,1 for i < j and 
Ci_j-|-i_i for i > j. Such a matrix is a special type of Toeplitz matrix. We introduce a class of 
weight functions used throughout this paper, it is defined and studied in [2, we state it here for 
completeness. 

Definition 2.1. Let r > 0. A real-valued sequence 7 = {7(?^)}ri>o in W(r') if j{n) > for all 
n > 0, and 

00 



(5) lim = -, 7(r) = } ]jii)r ' < 00, 

ri-s-oo 7(nj r 



(6) Jim ( lim sup —73- li""^ ~ *)7(*) 



7(n) 



i—m 
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Observe that if r < 1 and 7 G W(r'), then 7 decays; whereas if r > 1, 7 diverges. Criteria 
for showing that a sequence {7(n)}„>o is in >V(r) are given in [5]. Here we simply note that 
7(n) = r"n-" for a > 1; 7(71) = r"n-" exp(-n'^) for a e R, < /3 < 1; and 7(n) = ^"e-"/^^"^") 
all define sequences in W(r). The sequences defined by 7(n) = r", and 7(71) = r"n^", a < 1 are 
noi in yV(r). 

In this paper, we investigate a class of kernels which have the essential rate of decay of a 
sequence in >V(r), but exhibit a periodic "fluctuation" of period e N around this rate of decay. 
To encapsulate this idea we give the following definition. 

Definition 2.2. Let d, N e Z+/{0} and r > be finite. A sequence U = {?7(n)}„>o £ R'''''^ is 
in WT'{r, N) if there exists a function <p G W(r) and a sequence of d x d matrices {Ai}^^I^^ such 
that lini„_^oo U{Nn + i)/(j){Nn) = Ai. We refer to (j) as a weight function for U. 

If we wish to investigate the rate of decay of a function relative to a particular weight function, 
say 7, then it is desirable to know how '^{Nn) relates to 7(71). 

Lemma 2.3. Let N be a positive integer and r > 0. If (f> £ W(r) then $ G W(t), where 
$(n) := (j}{Nn) and t := 

Proof. Note that $(n) = (j){Nn) > 0. We estabhsh (O and © for $. Since $(n - l)/$(n) = 
(j){Nn - N)/(j){Nn) and (p obeys ©, we get lim„_^oo ^{n - l)/$(7^) = l/r^ = 1/t. Also 

$(t) = ^ $(i)T-' = 4>{Ni)r-'^' < J2 < 00. 

1=0 i=0 i=0 

Turning to © , by construction we have 

$(n~^)$(^) _ cj^jNn - Ni)<p{Ni) ^ "^"^"^ 0(iVn - z)0(z) 



Therefore 



$(n) 0(7Vn) ~ ^ (7!)(A^n 



limsup > — ^ < hmsup > (-^ < limsup > 



«^oo 4>iNn) L^oo .'^ 4>iL) 

i—Nm i—Nm 

The last inequality is obtained by letting L = Nn and noting that in the limit the sum to L — Nm 
will contain more terms than Nn — Nm. Finally, as (/) G yV(r) 

$(n-i)<i>(2) .r-^ (l)(L-l)(pU) 

hmsup hmsup y. , < hmsup hmsup >, , , 

z=m ^ ' t—Nm 

0(i — i)(j){i) 
< hmsup hmsup > T7T\ — 0, 

with the last inequality holding by reasoning similar to above. □ 

In determining the results in Section |3] we have used [2] Thm.3.2] which we state here for 
completeness. Note in this result and the rest of the paper that if 7 is a positive real sequence, 
/ G M'^i^''^, and lim„^oo f{n)/j{n) exists we denote the limit by L~^f. The theorem provides an 
explicit formula for L^z in terms of the data. 

Theorem 2.4. Let / : Z+ ^ M'' and F -.1+ ^ W^'^'^ and suppose {.z(n)}„>o obeys 

n 

(7) z(n+l) = /(n) + ^F(n-i)z(i), n > 0, z(0) = e R''- 

j=0 

Suppose that there is a ^ in W(r) such that L^f and LjF both exist, and that 

(8) p{r-'\F\{r)) ^ p(f2r~(^+'^\F{i)\) < 1. 
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Then the solution z of ^ satisfies 

(9) L,z = [rl - F{r))-'[L,f + {L^F)~z{r)], 

where z{r) ~ {rl — _F(r))^"'" [rzp + j{r)\. 

We provide a preliminary lemma which demonstrates that the inverse of a lower triangular 
block Toeplitz matrix is also a lower triangular block Toeplitz matrix. 

Lemma 2.5. Let B2,i, B^^i, B^ i be d x d matrices. Let B be a matrix in ^^dxNd ^^^^ 
N,d Z"*" such that B has the following block structure, for i,j — {1, ...,N}, 



- 



Od, ■ifi<j, 
Bi^j+i.i, ifi>j, 



where Od represents the d x d zero matrix. Then (I — B) ^ exists and setting C :— {1 — B) ^ we 
have 

{Orf, ■ifi<j, 
Id, ^ft^J, 
Ci-ij-i, ifi>j>l. 

and 

t-i t-i 

(11) Cta fort>2. 

1=1 1=1 

Proof. Note that I ~ B has ones on its main diagonal (ie. det(/ — B) — 1 0) and hence is 
invertible. The lower triangular structure of C is determined by considering the i,j*^ element of 
(/ — B)C and using an induction argument. We start by establishing the relation 

i — l i 

(12) a,, = ^M^^ij = for * > J- 

1=3 

First, we observe that 

i i 

Od = [C(/ — B)]ij — ^ Ci^i{l — B)ij — dj — ^ Ci^iBij 
i=j i=]+i 

By similarly considering [(/ — B)C]ij, one establishes (IT^ . We use induction to establish the 
third equality of pUj) . which is equivalent to 

(13) Cij = Ci-j+i^i, for i > j. 
We first prove Cj+ij — C24. From 

3 2-1 
^j+i.j = = I^3+iJ^3,j = ^2,1^14 = ^^-B2,;C;,i ~ C2,i 

1=3 1=1 

Now, assume Cp^q = Cp-q+i,i for all < p — g < i — j and p,q ^ {1, N} and i, j are fixed. 

i-l i-j 

= Bi~j+i,iCi+j-ij = Bi^j^iiCi^i = Ci-j+i^i. 

1=1 1=1 

Thus one has C^.j = C.i_j+i.i for all « > j. With (jl2p and (|T5)) established, we can conclude 
(dH). □ 

We supply a Lemma which will be used in the proof of the main result. Theorem 13.21 



5 



Lemma 2.6. Let {U{n)}nez+ be a sequence in M'*^'*. Suppose 

/ d N-l oo \ 



(14) 



\q=l i=Q 1=0 



Define, for some iV S {1, 2, . . . }, the matrix function F : Z+ ^ M.^""^ by F{n) = {I - B)-\J{n) 

for n>l, where the d x d block composition of B and J, for i,j G {1, --N}, is given by 

(15) 

{Od, ifi<3, 
Id, tfi^J, [Jin)]^.,J 

-U{i-j-l), ifi>j, 



iu{Nn + N + i-j -1), ifi<j, 
\U{N{n + l) + i-j-l) ifi>j. 



Then 
(16) 



i=0 



< 1. 



Although the entries [J(n.)]ij- of J{n) have the same form for all i and j, it is convenient in the 
proof to express them in the slightly differing forms displayed above. 



Proof We use the notation, for A e {0, • • • iV - 1}, 5a := Y.Zo r-^^\U{Nl + X)\ , S := ^^^^ 
and M := YT=o 



„-N(i+l) 



F{i)\. Note by (O that Hr-^^Hoo < 1- Hence, 



< 



.i=0 



-N[l + l) 



\J{1)\ 



r ^Sn+2-j~i, if i < j, 

5,_,_i-|f/(i-j-l)|, ifz>j. 



Also, for i > j and by noting that (/ — i?) is a matrix of the form in Lemma [2.51 we use ([TU)) 



N 
k=l 


oo 
_n=0 








fc=i 


oo 

^r-^('+i)|J(0| 

.n=0 


+ E i^i^^fc 


' oo 

^r-~('+i)|J(0| 

."=0 




-N Q 


'-j-i+ ^ \C\i,kiSk-j-i - 
k=]+l 


\U{k- 



where C := {I ~ B)^^ . Similarly for i < j we have Mij < X]fe=i \C\i,kr~^ SN+k-j-i- We note 
that, by definition Af is a non-negative matrix, that is, in verifying (fT6)) we need consider the row 
sums of M rather than \M\. We now compute the sum of each row of M and show that they are 
all less than one. The sum of the first and second rows are special cases. We compute the sum for 
the first row and also the general case; the sum for the second row is similar to the general case. 
For i = 1, 



AT 



N 



N 



Indeed, 



N 



d N d 



9=1 J = l 



9=1 
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For i > 3 

N i-1 N 

j=l j = l j=i 

i—1 j 2—1 i 

<^^\C\i,kr~'^ SN+k-j-1 +^ X! \C\i.kSk-j~i 

3 = 1 k=l j = l k=j+l 

i-l i N i 

-EE \ckk\u{k " J - 1)1 + E E ickfe^"^ 

1 i— 1 i k—1 

= E 1*^1*-'= E '^^'^ ^N+k-j-i + E 1^1^^'= E ^k-j-i 

k=l j=k fc=2 j = l 

- E i^i^fe E - J' - 1)1 + E 1^1^''= E '^"'^ w-.-i- 

fc=2 j = l fc=l j=i 

By moving the k = i terms from the second and fourth sum, and combining the first and fourth 
sum we get 

N i-1 N i-1 k-1 

E ^ E 1^1^^^ E r-^'SN+k-j-i + E i^kfc E '^'^-^■-1 

j=l k=l j=k k=2 j = l 

i k-1 N i-1 

(17) - l^kfc E - J - 1)1 + E ^"'^^A'-.+.-i + E ^^-^-^ - A2~A3 + Ai. 

fe=2 j=l ]=i j=l 

where the first two sums are A2, the next is A3 and the last two are Ai. Next, we write Ai as 

N-l i-2 i-2 

(18) ^1 = E ^""^^^ + E = '-"'^^ + (1 - ^"'^) E 

l=i-l 1=0 1=0 

As for A2 we rearrange to get 

i-1 N-l i-1 k-2 



A2 = j2\cu.k E r-^^^+Ei^k^E^' 

k=l l=k-l k=2 1=0 

i-1 N-l i-1 k-2 N-l i-1 k-2 

= E i^kfc^''" E - E 1^1^.^^"'" E + i^ki E + E i^k^ E 

fc=2 /=0 fe=2 1=0 1=0 k=2 1=0 

i-1 i-1 k-2 

(19) = J2 l^kfe^'"^^ + (1 - r-"") E 1^1^- E + l^ki^"'^^- 

k=2 k=2 1=0 

Regarding ^3, we note that by and (fTT|) Ci,fe = Ci-k+1,1 — — J2]=o^^ Ci^k-i.iU{l) for i > /c. 
Therefore 

i l — l i—1 i i—1 i — k 

A3^Y.\^kiY.\u{i~i-k)\^j2 E \cuu{i'k-i)\ = j2j2\^u^^+'^\u{i-i)\ 

1=2 k=l k=ll=k+l k=l 1=1 

(20) 

i — k-\-l — l i—1 i — k—1 i — 1 i—1 

= E E \cu-i-k+iMuii-i)\ = Y.T. ia.-/-Mic^(oi>Eicu+i,i = Eickfc- 

k=l 1=1 k=l 1=0 k=l k=l 
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Inserting (HH]), (HH) and ([20l) into ^J^j we ean write. 

N i-2 i-1 

M,, < r-^'S + (1 - r-^) E ^' + E l^l^'cr-^^ 



Z=0 fe=2 
i-1 fc-2 



+ (1 - r-^) ^ \C\,k + l^^l,:!^-"^^ - E l^l''^ 

+ (1 - r-^) 5] + 5] |Ckfc(r-^5 - /,) + (1 



k-2 



1=0 k=l 

We note that by conditions ([H)) we have 1 — < 0. Therefore 

AT i-1 



k=2 



1=0 



3 = i 



k=l 



Letting ^i,j]p,q denote the p, g*'' element of the d x d matrix X]/=i ^^ij^ have 



N 



N 



d N 



9=1 J = l 



Cd d d i-1 \ 

E ^'""^su + E E E i^i^'^]^'-" [^""^^ - 
(?=1 9=1 Q=l k=l ) 



d i-1 



max^ E ''"'^[^Ip.^ + EE |Ckfc]p.a(r-^ - 1) 



a=\ k=\ 



9=1 



<i^,-^>"''E[^W<i- 



9=1 



With the last two inequahties holding as r ^ Y^\^^\S\a^q < 1 for aU a G {!,■■■ ,d}. Thus 



IMII 



maxi<i<Ar(|| X],=i -^ijlloo) < 1 and ([TC)) is satisfied. 



□ 



3. Main Results 

We next show that the solution Z of equation ([2]) is in WV{r, N) with weight function ip, when 
the kernel U lies in WT'{r, N) with weight function </>. Once the behaviour of Z is known, a 
variation of constants formula readily enables us to determine the asymptotic behaviour of the 
solution of ([ij. Firstly we give a lemma concerning the summability of Z. 



Lemma 3.1. Let Z be the solution of ©. // ^ holds then E,=o^ E^^o ^"^^"^^^ 
is finite and the following inequality holds: 



n + 1} 



7V-1 oo 



J2 ^r-^("+i)|Z(7Vn + z)| <r-^/+ 



=0 n=0 



/N-1 



, i=0 n=0 



-N{n+l) 



\U{Nn^i)\ ^r-^("+i)|Z(7Vn + i)| 



, i=0 ri=0 



Theorem 3.2. Let {Z{n), n eN} be the sequence which satisfies Suppose that U G W7'(r, N) 
with weight function (f) G VV(r) such that there exists a sequence of d x d matrices {^i}^o^ '^^^ 

1 



(21) 



lim 



U{Nn + i)=A„ i G {0,1,2,...,7V- 1}, 



(22) 
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(d N-1 oo \ 
J2Y.Y.'-''^'^"^mNl + ^)\,^<l, r<l, 
q=l i=o /=o / 



for some iV e N. Then Z e WV{r,N) and there exists a {pj e W'-^''- such that 
(23) Mm —^ZiNn + i)=: p,. 

n->oo lp[l\n) 

Remark 3.3. Condition I^T^ gives us the rate of decay of the components of U{Nn + i) for each 
i. Hence it encapsulates both the decay and periodic components of the kernel. Condition ([2^ is 
imposed in order to ensure stability of the problem. While the 1 1 ■ | |oo is employed here for simplicity 
and to ease the calculations involved, we speculate that other norms may also be possible while 
noting the equivalence of norms for scalar functions. The result ([25]) is analogous to (HI]), that is 
that the solution of inherits the same rate of decay as U, and also retains a similar periodic 
component. We note that while it is possible to calculate an explicit formula for pi, it is in general 
far more complicated than the constant matrix Ai. That such limits may in general prove rather 
unilluminating may be seen from the explicit example in Section |4l 



Remark 3.4. Later, we give a partial converse to Theorem 13.21 which illustrates the sharpness of 

(ED), (EH). 

Proof of Theorem \3.'A We first develop a system of equations from which can be put into the 
form of ([7]) . We then focus on ensuring that all the conditions of Theorem 12.41 hold. From ([2]) we 
can write for i > 0, 

Nn+i-l 

Z{Nn + i)= ^ U{j)Z{Nn + i - I - j) 

3=0 
n i — l 

^^Yl ^^^^ + j)Z{Nn + Nk~ j) 

k=0 j=0 

71-1 N-l 

+ YY1 ^'^^^ + + Nk- j) 

k=0 j=i 

i—l n—1 i—l 

= U{j)Z{Nn + i- j - l) + J2Yl U{N{k + 1) + j)Z{N{n ~ k - 1) + i - j - 1) 
j=o k=o j=o 

N-l n-l 

+ + -k-l) + N + i-j -1) 

j—i k—0 
i — l i — l n—1 

= J2 U,m^-j-i{n) + U,{k)Z,.,.,{n -1-k) 

j=0 j=0 k=0 

N-l n-l 

j=i k=0 

where in the last line, we set Zi{n) Z{Nn + i); Ui{n) := U{Nn + i); and Ui{n) :— Ui{n + 1). 
Thus 

i-1 i-1 N-l 

(24) Z,{n) = Y U3{0)Z.,-j-i{n) + ^ (c7,_i_, * Zi) (n - 1) + ^ {UN+^-l-l * Zi) {n - 1). 

j=0 1=0 l=i 

In the case when i — 0, a, similar result is obtained, but neither the second nor the third term 
appear in ([M)) . Thus, for i £ {0, 1, — 1} we generate a system of equations 

(25) 2:(n) = B-Z(n) + (J*Z)(n- 1), n > 1, 
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where Z{n) e R^"^""^, B e M^'^x^'' and J{n) £ R^dxNd ^j^^^.^ f^^. ^ {1,2.., A^} we define 
(26) 

r^/ M 7 ( \ u ifp<9, w X iUN+p-q-iin), ifp<q, 

[Z{n)]p = Zp^i{n), Bp^q^i n -f ^ ' "^Wp^? = i fr -f 

itp>g. \Up-q-iin), it p > q. 



Note that / — S is in the form given in P3|) in Lemma 12.51 so {I ~ B) ^ exists. Equation (|25p 
simplifies to 

(27) ^(ri) = (-F*^)(?^- 1), n > 1, 

where F{n) := {I — B)^^J{n). In order to satisfy the conditions of Theorem 12.41 we need to show 
that, for some weight function, /i, in W(s), L^F exists and that 

(28) p(y^s-^'+'^F{^<1. 

We note that a natural choice of fi is {$(?t.)}„>o {4>{Nn)}n>o as L,^F is well-defined. We note 
by Lemma [231 that $ is in W(r^). Observe tliat ^ [I - lim„^oo Jin)/^{n), and the 
limit exists because 



lim -^^Jin) 



71— >00 



AN+p-q-1, itp<q, 
Ap-q-ir'^, itp>q. 



(29) 

Turning our attention to (j28p . we see what is needed is 

(30) p(^^r-^('+l)|F(^)|^ <1. 

However, by (U) we need only check || X)i^o \\°° ^PPlyi'^g Lemma [2.61 we see 

that ((30|) holds. Therefore, L^Z exists and is given by Theorem 12.41 Hence, by looking at the 
components of Z_ we see that Z{nN + i) /(f>{Nn) pi, as n oo. □ 

Proof of Lemma\Mi Define Z^{n) = Z{Nn + i), U^{n) = U{Nn + i) for i £ {0, 1 . . . , A^- 1}. Then 
by ©, Zo(0) =/, and 

i-l 

Z,(0) = U^-p-l{0)Zp{0), {!,..., N-1}, 

Zoin) = Y'YUN-p~i{n-l -l)Zp{l), n>l, 

1=0 p=Q 

n i-l n-lA'-l 

= C/»-p-i(^i - 0^p(0 + UN+;-p-i{n - I - l)Zp{l), n>l,l<i<N~l. 

1=0 p=0 1=0 p=i 

Then taking absolute values across ([2]) and summing we have 

N-l T N-1 T 



^ ^^_^r(„+i)|^^(^)| < ,-N^Zom + E r-^|Z,(0)| +^^-"^^"+'^1^0(^)1 

n=l 

N~l T 



2:^0 n— 2—1 n— 1 



2—1 n— 1 
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where T is a large fixed integer. Substituting the above representations for Z into this equation 
and permuting sums yields 

AT-l T 
i=0 n=0 

N-2N-p~2 N-lT-lT-l-1 

p=0 q=0 p=0 1=0 n=0 

N-2N-P-2 T T-l 

+ T. EE-"''^"^'^'^if^«wii^.«i 

p=0 q=0 1=1 n=0 

N-2N-P-2 T N-1 N-1 T-lT-l-1 

+ E E E'--'^^"^'^if^.wii^p(o)i + E E E E r-^<"+'+^^ic/«(n)ii^.(oi- 

p=0 q=0 n=l p=l q=N-p 1=0 n=0 

The remainder of the calculation hinges on careful splitting and recombination of these sums, and 
by replacing T — c by T in various upper limits of summation. Successively, we estimate according 
to 

N-1 T 
i=0 n=0 

N-2N-P-2 N-1 T T 

<^"^^+E E r-^ic/,(o)ii^p(o)i + EEE^"'''"^'^'^|t^^-p-iWii^p(oi 

p=0 q=0 p=0 ;=o n=0 

N-2N-P-2 T T 

+ E E EE^-'^^^^'^'^if^.wii^.wi 

p=0 q-0 1=1 n=0 

N-2N-P-2 T N-1 N-1 T T 

+ E E E-""^"^'^i^.Hii^.(o)i + E E EE-""^"^'^'^it^.wii^.(oi 

p=0 9=0 n=l p=l q=N—p 1=0 n=0 

N-2N-P-2 T N-2N-P-2 T T 

= r-''i+Y. E E^"''^"^'^i^'^Hii^^(o)i + E E EE^"''^"^'^'^it^«wii^^'(oi 

p=0 g=0 71=0 p=0 q=0 1=1 71=0 

T T AT-l N-1 T T 

+EE^"'''"^'^'^|t^^-iWii^oWi + E E EE^"'''"^'^''it^'/Wii^p(oi 

i=0 71=0 p=l q=N-p-l 1=0 71=0 

N-2N-P-2 T T T T 

= r-''i+Yl E EE^"''^"^'^'^i^«wii^p(^)i+EE^"''^"^'^'^i^^-iHii^o(^)i 

p=o g=o ;=o 71=0 ;=o 7i=o 

N-2 N-1 T T N-1 T T 

+ E E EE-"''^"^'^'^i^«Hii^p(oi + EEE-"''^"^'^'^i^«Hii^^-i(oi 

p=l q=N-p-l 1=0 n=0 q=0 1=0 n=0 

N-2N-P-2 T T T T 

<--"^^+E E EE-"''^"^'^'^i^«wii^f(oi+EE-"''^"^'^'^i^^-iHii^oWi 

p=o g=o ;=o 71=0 ;=o 7i=o 

N-2 N-1 T T N-1 T T 

+ E E EE-"''^"^'^'^it^«wii^.(oi + EEE-"''^"^'^'^|t^«Nii^^-iWi 

p=l q=N-p-l 1=0 n=0 q=0 1=0 n=0 

(N-1 T \ /N-1 T \ 

g=0 71=0 / \p=0 1=0 J 
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where the last inequahty holds as 1 < r ^ . Therefore by ([22]) 
(31) 

i=0 n=0 \j=0 «=0 / \i=0 1=0 J 

Due to condition ((22|) . we have that — X^jL^^ exists and moreover 

is a non-negative matrix. Hence we have 

-1 

-N 



N-1 T / N-1 oo 



i=0 n=Q \ j=0 71=0 



r 



Noting that each entry in the lefthand side of the above inequality is an increasing function of T 
and is bounded above by a term which is independent of T, tells us that each entry of the matrix 
has a finite limit as T — > oo. This proves the result. The inequality in the statement of the lemma 
follows by letting T ^ oo m dST]). □ 

The following corollary applies Theorem 13.21 to ([1]). 

Corollary 3.5. Let {X{n) : n e N} &e the solution of H]), {Z{n) : n G N} the solution of © 
and e W(r) and ^ hold. Let {/Oi}^o^ he given by Theorem\EM and i € {0, l,...,iV- 1}. 

Suppose Imin^Qo f{Nn + i)/cj)(Nn) = Li. Then Imin^oo X{Nn + i)/(j)(Nn) exists and can be 
calculated. 

Remark 3.6. Other results in the direction of Corollary [331 are certainly possible to state in which 
the rate of decay of the perturbation is different to that of the kernel or where their periods 
differ. The proofs follow readily by the variation of constants formula and the facts that (i) the 
convolution of two sequences which lie in WP{r,N) also lies in yVV{r, N). (ii) the sum of two 
sequences in yVP{r,N) is also in WP{r, N). Therefore, we do not dwell on this issue but leave it 
instead to the reader's imagination to consider these obvious extensions. 

Proof of Corollarv \3.5\ By Theorem 13.21 we have lim„^oo Z{Nn + i)/<j){Nn) — pi. Using ([3]) and 
the same argument at the start of the proof of Theorem 13.21 we can write 

i N-l 

X{Nn + i)^ Z{Nn + i)X{0) + Y,^Zi*F,^i)(n)+ ^ {Zi * FN+^-l){n - I), 

1=0 1=1+1 

where /(O) := 0, Za{h) := Z{Nb + a) and Fa (b) := f{Nb + a), a e {0, 1, . . . , iV - 1}, 6 G Z+. Define 
= (l3{Nn). Using O Thm:4.3] and $ G W{r^) we obtain 

^S?^ - ^^^(«) + E E ^'-'(^>-"^' + E E ^K.>-^^-^.-. 

' 1=0 j=0 1=0 j=0 

N-l oo N-l oo 

(32) + Y: P.E^^+-'0>"''^^'^'^ + E E^'(J>~^(^■+^^i^+.-^ 

l=i+l j=0 l=i+l j=0 

which completes the proof. □ 

We close this section by noting that Z G W(r, N) is in some sense only possible HUE W(r, N). 
This result is a consequence of Theorem 13.21 and Corollary 13.51 

We note that one may show, via induction, that the solution Z oi ^ can be expressed as 
Z{n) = U{n - 1) + X;"=2 U'^*^Hn - j), for n > 2, with Z{1) = ;7(0), Z{Q) = I. Furthermore this 
representation allows one to show that Z is also a solution of the equation W{n+l) = {W *U){n), 
n > 0, W{0) = L. Hence {U * Z){n) = Z{n + 1) = W{n + 1) = (W^ * U){n) = [z * U){n). 
By rewriting we get U{n + 1) = Z{n + 2) - Y^'jll U{n + 1 - j)Z{j) for n > 0. Putting 
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Y{n) — —Z{n + 1) we see that 

n 

(33) U{n + l) = -Y{n + l)+J2u{n~l)Y{l), n>0. 

1=0 

We now argue that {U *Y) — (Y *U). For n > we have 

n n 

{U * Y){n) = -Y,U{n- j)Z{j + 1) = - ^ C/(n - j){U * Z){j) = -{U *U * Z){n). 

Similarly {Y * U){n) = -{U *Z* U){n). But Z *[/ = [/* Z, so (C/ * Y){n) = -([/ *U *Z){n)^ 
-{U*{Z* U))in) = {Y * U){n). Therefore Q becomes 

n 

(34) U{n + l) = -Y{n + l) + ^Y{n-l)U{l), n > 0. 

which is in the form of (HJ. We introduce the resolvent R by R{n + 1) = Sj=o ~ i)-R(j) for 
n > 0, where i?(0) = /. We now give conditions under which Theorem 13.21 can be applied. If we 
suppose that Z obeys then for i = 0, . . . , — 1 we have 

(35) niX!i±i = _ li,^ ^(iX!i±l±l) * = 0,...,A^-2 

^ ' n^oo 4>{Nn) ri^oo 4>{Nn) [-r^po, i = N-l. 

Moreover, the condition 

(d N-1 oo \ 
q=l i=0 1=0 I 

is equivalent to 

(d N-l oo \ 
g=l i=0 1 = J 

and by applying Theorem 13 . 2 1 with y in the role of U and R in the role of Z, there exist G R'^^'' 
for i = 0, . . . , iV — 1 such that lim„^oo R{Nn + i)/4>{Nn) —: Di. Using this limit in conjunction 
with ([55)1 . we may now apply Corollarv 13.51 to to deduce that there exist Ai G W^^'^ for 
« = 0, . . . , — 1 such that lim„^oo U{Nn + i)/ip{Nn) —: Ai. However we would rather replace 
with a norm condition on U (see ([57]) below) which must be stronger than (1^^ , as this would 
then yield a converse with conditions closer to that of Theroem 13.21 By virtue of the discussion 
above, what remains to be proved in the converse below is that ((37|) implies (l36l) . 



Theorem 3.7. Let {Z{n),n £ N} be the sequence which satisfies Suppose that Z S yVV{r, N) 
with weight function (f> in W(r) so that there is a sequence of d x d matrices {pi}^^^^ and 

lim ^^Z(iVn + z) =p,;, ze{0,l,2,...,iV-l}. 

n=yoo (p[l\n) 

Also suppose 

Cd N-l oo \ 
q=l i=0 1=0 / 

holds for some N ^N. Then U G yVV{r, N) with weight function (j> i.e., there exists {Ai} £ R'^^'^ 
such that 

1™ :^7^^(^" + «) - * e {0, 1, 2, N - 1}. 

Remark 3.8. In the special case where there is no periodicity (i.e., = 1) the necessary and suffi- 
cient nature of Theorems 13.21 and 13.71 is an improvement on the sufficient nature of the conditions 
of Theorem El 
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Proof. Wc show that ((37|) inphes ((36)) . Regrouping the terms in (|36| . one deduces 

/ d JV-l oo \ 



l<p<d , 
~ \g=l i=0 1=0 



= ir<-,E E'-'''i^wu + EE-"''*'^'^i^(^^+^')i^'.'^+E^"'''i^(^oip,, 

q=l = l j=l 1 = 1 1=1 

Hence, using 1 < r^^ , 

(d N-l oo \ 
EEE^-"^'"^^i^(^'+^ + i)ip. 
q=l i=0 1=0 / 

d /n-1 N-1 oo oo 

q=l \j=l j=l 1=1 1 = 1 

d /n-1 oo 

= i^%-,E EE^"''^'^'^i^(^'+^')i?'.«-^"''i^(o)ip.. 

q=l \j=0 1=0 

(38) 

d /n-1 oo 



i<p<d' 

~ g=l \ i=0 1=0 



with the last equahty holding as Z{0) — /, whose rows sum to one, which is independent of p. De- 
fine the matrices A = Ef=o^ E7=or'^^"^^^\Z{Nn + t)\ and B = Eto' ^^=0 ''"^^"^'^ + 
Then Lemma IXTl gives A < r^^ I + BA or equivalently A < (I — B)~^r~^ , with the direction 
of the inequality being preserved due to B > and the expression (/ — B)^^ = J^lZo which is 
valid due to ([37]). Taking the infinity norm on both sides of this inequality gives 



B' 

;=o 

Combining this with ((38|) gives 



E^' 



1- ll^ll 

1=0 1=0 " " 



(d N-1 oo \ 
E E E ^"""''^'^ + * + i)u < Piioo - r-^ < '^"^ 
q=l 1=0 i=0 / 



- llBlloo 



^9= 

Thus if r^^/(l — ||i?||oo) — r"^ < 1 we have our result. But this inequality is equivalent to 
||B||oo < 1/(1 + r-'^) < 1/2 < 1, which is true by hypothesis. □ 

4. Examples 

We provide an application of the above theory to analysing the memory characteristics of auto- 
regressive conditional heteroskedastic processes of order infinity. We briefly give some background 
details pertaining to the memory properties of ARCH(cx)) processes, see [H O [71 [TU] for more 
detail. 

Definition 4.1. A random sequence {X{k),k G Z} is said to satisfy ARCH(oo) equations if there 
is a sequence of independent and identically distributed (i.i.d.) nonnegative random variables 
{^{k),k e Z} such that 

(ARCH) X{k)^(a + f2 b{j)X{k - j)) m, 

V j=i / 

where a>0, b{j) > 0, for j = {1, 2, ...}. 
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The condition 

oo 

(39) E[m]T.^{j)<h 

is imposed in \T to show the presence of a strictly stationary solution of (jARCHp . While the 
condition 

oo 

(40) E[^(0)2]^^6(j)<l. 

is shown in [5] to imply a unique weakly stationary solution in the class of all stationary solutions 
with finite second moment, it is further shown in [5] that (j40p implies the positivity and absolute 
summability of the autocovariance function of stationary solutions of (|ARCH[) (ie. long memory 
is ruled out). 

Moreover [5] establishes a moving average representation for (jARCH|) . It is remarked in O 
pp.16] and [ini pp.154] that it is the asymptotic behaviour of the coefficients in this moving average 
representation which impart the rate of decay of the auto-covariance function of (jARCHI) . The 
precise influence of these coefficients is the subject of a result in [TU]. We give the set up of 
this theorem; let = 1 — E[^(0)] J^JLi b{j)L^ , where L is the lag operator (i.e. L{X{k)) = 

X{k — 1)) and define v{k) :— X{k) — E[^(0)]cr(fc), where is a martingale difference sequence, ie. 
E[i/(fc)| J/c_i] = and Tk-i is the cr-algebra generated by ^fc_i,^fe_2, .... Then from (|ARCH|) we 
have %}){L)X{k) = aE[^(0)] + v{k). Assuming the invertibility condition ([TU], Lm.4.1]), 



oo 



(41) 3 D{z) = ^ 5{j)z' ^ -i^, J(0) = 1, for all \z\ < 1 such that ^ S^{j) < oo, 
then 

oo oo 

(42) X{k) = aEK(O)] J2 ^U) + E '^(•?>(^ - ■?■)• 

3=0 j=0 

Conditions for weak stationary are examined in [TU] . In particular the following condition is weaker 
than ^M- 



(43) E[(^(0)-E[e(0)])2] J2 Xs{u)xb'iu)<l. 

U — --00 

Here xdu) ET=o cUHj + H) for any sequence c £ 6*(j) = if j = 0, and b*{j) = b{j) 

otherwise. implies absolute summability of the auto-covariance function, so both (|43l) and 

(HUl) rule out long memory. In particular [TOJ Thm.l] shows that the auto-covariance function of 
(lARXJHIl obeys Cov[X (k), X{k+u)] = Cxsiu) for some < C < oo, where xsiu) = X;°lo Hj)SU + 
\u\), u E {0, ±1, ...}. Regarding [TUl Thm.2], we demonstrate some flaws concerning the asymptotic 
decay of the autocovariance function following that of S. 

[TUl Thm.2] asserts that if there exists a function 5, defined according to [TUl PP-149], and p9p 
and 

b(k) 

(44) lim = oo, for any < C < 1, 
hold, then 

(45) xs{k)^Cibik), (fc^oo), 

for some < Ci < oo, with c{x) ~ d{x) as x ^ xq, meaning that c{x)/d{x) 1. 
In the forth-coming paper, pP, it is shown that 6 satisfies the following equation, 

ri-l 

(46) S{n)^E[aO)]J2b{n-mj), n>l, S{0)^1. 

3=0 
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Indeed one can think of 5 as a resolvent for a Volterra equation, derived in [1 , which is satisfied 
by the auto-covariance function of the ARCH((X)) process. 

We consider the sufficiently simple case of a scalar Volterra equation where the kernel has a 
'two-periodic' {N — 2) component. We believe that this example is instructive in demonstrating 
the complexity of the calculations for higher d or N, while retaining results which are eminently 
verifiable. 

The idea of the example is that if b obeys (I44p and also contains a periodic component then xs 
will have a similar rate of decay to b but their periodic components will not be in phase and hence 
b ^ Xs- Our first illustration of the theory deals with the ratio of 5/0; the second uses this result 
to analyse xs/fp- 

Example 4.2. 

We can take Ai := E[^(0)] > as if Ai = then ^(n) = for ah n G Z+. Let Ai6(2n + i + 
l)/(/i(2n) tti > for i £ {0, 1}, for some <j) G W(l) and oq ai. Let dSH]) hold. Observing that 
(^51) is of the form of , we apply Theroem 13.21 to (|46l) giving, 

S(2n) , , 6(2n+l) 

do lim = aoTo + aiTi, di lim — , = oiTq + aoTi, 

n^co (pyZn) n^co (p[Zn) 

where Tq = A(2S'o(l-5i)), T, - A{S^ + {l-Si)^), A = {{l-Sif-Siy^ and = Ai E,°lo K2j + 

Remark 4.3. In order to achieve 5 (j) (or do — di) one might consider Tg = Ti, this however 
leads to 5*0 + 5*1 = 1, ie. a contradiction of Hence in general 5 is not asymptotic to (f>. 



Remark 4.4. We provide a numerical illustration where all of the limits in Example 14.21 mav be 
computed explicitly. Define (t){n) = n^"^ for all n > 1 and (/>(0) = 2. Let b{j) = aij~^ for j/2 G N, 
b{j) = aoj~^ for j72 ^ N, where aq := 0.5 and oi := 0.25. Furthermore let {^{n)}n£Z be an i.i.d. 
non-negative stochastic process with mean equal to unity (ie. Ai = 1). Thus it is calculated that 



-1 7 ^ -1 

1 „ . ST^ 1 



^0 -aoAi^ (2j + l)2 " 16' ^i-^i^iH 



, ^„ ^ 22(j + 1)2 96' 

Noting that + 5i < 1, one can evaluate A, Tq and Ti respectively and hence do and di. Indeed 
A = 5.55073..., To = 6.14391... and Ti = 6.58015..., which gives do = 4.71699... and di = 4.82605.... 

Example 4.5. 

We show that while it is possible to have (j44l) one need not have (j45p . We proceed with the 
same set up as in Example 14. 2 [ noting that is satisfied. Let (f> be asymptotic to a decreasing 
sequence. Now observe, 

oo oo 

Xs{2u) = J2 '5(2(j + u))S{2j) + S{2{j + u) + l)S{2j + 1), 

oo oo 

Xsi2u + 1) = ^ S{2{j +u) + l)S{2j} + S{2{3 +u + l))5{2j + 1). 

Thus for some sufficiently large positive integer M, we have 

X5{2u) ^ S{2{j+u)) ^ S{2{j+u) + l) 

^ 5{2{j+u)) ^ 5{2{j+u) + l) 
+ 2. 0(2.) ^(^^I^ '5(2, + 1). 

For the third sum, recalling that 5 G £^(Z+) as ([59]) holds, 

^ 5(2(j +.)) ,,,., ^ 5(2(j+z.))0(2(j+z.)) ^,^., ^ 

0(2.) '^('^^= mj+u)) <P(2u) '5(2j)<4do )^ <5(2,). 
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The fourth sum can be treated similarly. Recalling the non-negativity of 6, we have 

lim lim V '-^±^Si2j)^ hm lim V '-^^il±^Si2j + 1) ^ 0. 

M^oou^oo ^ (h(2u) M^oou^oo ^ (h(2u) 

j=M+l ' j=M+l ' 

For the first sum we see 

i=0 ' j=0 j=0 

and a similar calculation applies to the second sum. Thus, after a similar analysis of xsi'^u + 1) 
we have 

1™ ^St^ = ^0 E + rfi E -^(^^^ + 1) = «"^o + 

tl-!-(X) (f)(2u) — ' ^ — ' 

(9 -4- ^ ] °° oo 
1™ ^'^^o ^ = cfi E + rfo V Si2j + 1) = aoTi + aiTo, 

^ 3=0 j=0 



where 



oo oo 



To = To}^ 6(2 j) +T,}^ S{2j + 1), n = Ti ^ S{2j) + To 2^ <^(2j + 1). 

3=0 j=0 3=0 3=0 

Thus for xs ^ b we need lim„_j.oc Xs{2u)/b{2u) ~ lini„_j.oo Xs{2u + l)/b(2u+l), which is equivalent 
to ro(ao — ai){aa + ai)/{aoai) = 0, which can only occur if either oq — ai or tq — 0. The first is 
ruled out by hypothesis. For the second, summing over for both S{2n) and S{2n + 1) gives 

oo / _! Q N oo ^ 

which gives tq the representation 

^ A5'o(5'g + 3(l-^i)^) 
(l-^i)^-^o' ■ 

Thus, To cannot be equal to zero (as otherwise ao — 0). Thus, while b{i)/C,'^ ^ oo as i — cxd for 
any < C < 1 we do not have x^i^) ^ Ch{u), ds u ^ oo, for some < C < oo. 

Remark 4.6. Following on from Remark 14.41 one can compute the various limits and infinte sums 
in Example 14.51 ie. J2'jLo H'^j)iJ2jLo ^i'^J + 1); "^o and n respectively and hence we have 

hm = Ai(— To + Ti) = 67.9375 .. ., lim — — — ——= Ai(—to + ti) = 34.1128 .. . 

ti->-oo b{2u) ai u^oa b{2u + I) ao 

Thus as both A and tq are positive (approximately 5.55073 and 22.5498 respectively), we have 
that the above two limts are unequal and hence xs{u) 7^ Cb[u) as u — > 00 for some < C < 00. 
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